Effects of degree distribution in mutual synchronization of neural networks 
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We study the effects of the degree distribution in mutual synchronization of two-layer neural networks. We 
carry out three coupling strategies: large-large coupling, random coupling, and small-small coupling. By com- 
puter simulations and analytical methods, we find that couplings between nodes with large degree play an 
important role in the synchronization. For large-large coupling, less couplings are needed for inducing synchro- 
nization for both random and scale-free networks. For random coupling, cutting couplings between nodes with 
large degree is very efficient for preventing neural systems from synchronization, especially when subnetworks 
are scale-free. 
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Synchronization phenomena in neural systems have at- 
tracted much attention. These phenomena are thought to be 
important for functioning neural system, such as neural cod- 
ing, visual information processing, sleeping, and memory in 
brain Ql 0, H, 01. Besides the complete synchronization, 
which results in identical states of all neurons in a uniform 
population, more subtle forms of synchronization should be 
present for examining the brain functions. The brain is essen- 
tially a system of interacting neural networks and the activity 
pattern of different networks may become synchronized while 
retaining their complex spatiotemporal dynamics. Therefore, 
it is interesting to investigate mutual synchronization in en- 
sembles of coupled neural networks |5[]. This problem has 
been studied on fully connected networks [6] and on random 
networks Q]. 

Recently, it was suggested that connectivity in neural sys- 
tems is more complex [8]. The effects of complicated topolo- 
gies on network dynamics have been confirmed in some the- 
oretical studies. For instance, small-world neural networks 
give rise to fast system response with coherent oscillations 
12]. Scale-free Hop field networks can recognize blurred pat- 
tern efficiently II10I1 . Complex networks have both sensitivity 
and robustness as responding to different stimuli 1 1 1]. On the 
other hand, synchronization is not always desired in neural 
systems. For instance, several neurological diseases such as 
Parkinson's disease and epilepsy are caused by synchronized 
firing of neural oscillators 11211 . So it is also important to study 
desynchronization and instability of synchronized motion of 
neural systems. 

In this paper, we investigate the efficiency of scale-free 
topology in inducing synchronization and preventing the sys- 
tem from synchronization in two-layer neural networks. We 
carry out three coupling strategies between subnetworks: 
large-large coupling (couplings built between nodes with large 
degree); random coupling (couplings built between randomly 
selected nodes); small-small coupling (couplings built be- 
tween nodes with small degree). Computer simulations re- 
veal that couplings between nodes with large degree play an 



important role either in inducing synchronization or prevent- 
ing the system from synchronization. An analytical treatment 
confirms the numerical simulation result. 

We consider a neural network model that consists of N 
neurons Xi(t) 6 (—1,1), i = 1, ••• ,N. The topology of 
networks was represented by symmetric adjacency matrix A 
whose entry a,ij — 1, • • • , N) is equal to 1 when neu- 
ron i connects to neuron j, and zero otherwise. Each link 
has a weight which is a random number distributed uni- 
formly in the interval between —1 and 1. The system con- 
sidered is composed of two identical neural networks, and a 
part of corresponding nodes in different subsystems is cou- 
pled together. The dynamics of the system is described by the 
following equations |6|,LZ|], 

x\{t + 1) = (1 - £i)G(/i 1 (t)) + eMh}{t) + &?(*)), 
x?(t + 1) = (1 - ei)Q(hm + e t e(h}(t) + />?(*)). (1) 

In the equation, £$ represents the coupling strength between 
the nodes i in different networks. When a pair of nodes is 
coupled, the coupling strength between them is equal to a con- 
stant £i — e, otherwise e\ = 0. For large-large (small-small) 
coupling we choose a group of nodes which consists of the 
nodes of greatest (smallest) degree in a subnetwork, and take 
£j = e if node i is in the group. Here h\(t) is the local field of 
the ith neuron and is expressed by 
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;•(*), 1 = 1,2 
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denoting the signal arriving at neuron % at time t from neurons 
of the same network. The local field is determined by the 
network topology. The non-coupled nodes in each subnetwork 
interact indirectly with another subnetworks through the local 
field. The activity function Q(r) is defined by 



8(r) = [1 + tanh(/3r)]/2, 



(3) 
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where (3 — 1 /T characterizes a measure of the inverse mag- 
nitude of the amount of noise affecting this neuron, perform- 
ing the role of reciprocal temperature in analogy to thermo- 
dynamic systems. For convenience, we set [3 = 10 through 
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FIG. 1 : (color online) Histograms of the number of couplings needed 
by the system to reach synchronization for three coupling strategies: 
large-large coupling (solid), random coupling (dash), and small- 
small coupling (dot), respectively. The system is composed of BA 
networks (a) or ER networks (b) with N = 1000, (k) = 20, and 
e = 0.6. 1000 simulations were performed for each histogram. 



FIG. 2: (color online) The number of couplings (fractions of to- 
tal nodes) needed for reaching synchronization as a function of 
the coupling strength e for three coupling methods. The system 
is made up of BA networks (a) or ER networks (b). Parameters: 
N = 1000, (k) = 20. 



all simulations. The initial states of all neurons in two subsys- 
tems are randomly chosen. To measure coherence in this cou- 
pled system, the dispersion of activity patterns is introduced 

1 2 N 

£, (*) = oEEHw-^)] 2 , (4) 

1=1 i=l 

where Xi(t) = Ym=i x \{t)/2 is the average activity of neu- 
rons occupying the position i in both subnetworks at time t. 
The dispersion vanishes when the system reaches the com- 
pletely synchronous state. 

Firstly, we investigate the number of couplings needed be- 
tween two subnetworks for system synchronization to study 
the efficiency of the network topology. In Fig. Q] we plot 
the histograms of the number of couplings built to guarantee 
synchronization for scale-free and random networks. We use 
Barabasi-Albert (BA) arithmetic II 1311 to generate the scale- 
free network and use Erdos-Renyi (ER) arithmetic d 1 4fl to 
construct the random network. According to the parameter 
setting in 111 ill , we also choose the size (N — 1000) and av- 
erage degree ((k) = 20) for both kinds of networks. When 
subnetworks are scale-free (see Fig. [Tf a )X the mean fraction 
of couplings are 58.2%, 80.7%, and 95.6%, corresponding to 
the large-large coupling, random coupling, and small-small 
coupling, respectively. This implies that the large-large cou- 
pling strategy is more efficient than the random coupling and 
the small-small coupling is the most inefficient method for 
inducing synchronization. In addition, the small-small cou- 
pling can be regarded as removing couplings which link nodes 
with larger degree from the globally coupled system. There- 
fore, removing couplings among nodes with larger degree at 
the initial state can efficiently prevent the system from syn- 
chronizing. In contrast to the case of scale-free topology, the 



peaks corresponding to three coupling methods for the system 
consisted of random networks are more closer (see Fig. 02b)X 
which is caused by the homogeneous distribution of network 
connectivity. This implies that the topology of subnetworks 
and the degree of coupled nodes influence the efficiency of 
the system, and the scale-free topology is more efficient than 
random network for inducing synchronization or preventing 
the system from synchronized states. 

Figure [2] shows the fraction of couplings needed to induce 
synchronization versus the coupling strength e. Whether sub- 
networks are scale-free or random, there is a critical point 
e c = 0.44 below which partial coupled networks can not syn- 
chronize. For e > e c , degrees of nodes taking part in interac- 
tions between two subnetworks will efficiently affect synchro- 
nization or the prevention of networks from synchronization. 
The larger the parameter e is, the less couplings are needed 
for system synchronization. Furthermore, given the coupling 
strength, the scale-free topology is more efficient than the ran- 
dom graph to synchronize in the case of large-large coupling. 

We now examine the dependence of the fraction of cou- 
plings needed for synchronization on the average links per 
nodes (k) in a subnetwork. For small (k), due to few neigh- 
bors per node and weak indirect interaction between non- 
coupled nodes, more couplings are needed for networks to 
synchronize. For large (fc^, different from classical results of 
network synchronization [15], the coupled system still needs 
many nodes to be coupled to ensure synchronization. Figure[3] 
displays a surprisingly nonmonotonic dependence of the frac- 
tion on (k) for given network size and the coupling strength, 
i.e., there exists an optimal value of (k) for which the fraction 
of couplings reaches minimum. With the increase of (k), the 
interaction of nodes inside a subnetwork is enhanced through 
the local field. The enhanced inside interaction brings the big 
indirect interaction between non-coupled nodes, which helps 
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subnetworks (k). So the total degree of coupled nodes is 
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FIG. 3: (color online) The dependence of the fraction of couplings 
needed for reaching synchronization on the average degree of sub- 
networks, BA networks (a) or ER networks (b). Parameters: N = 
1000, e = 0.6. 



J2h= {k)F r 



(5) 



where fcj is the degree of neuron i. For any network topology 
with the same average degree and size, the fraction of cou- 
plings is the same in the case of random coupling. Following 
ideas developed by Bar- Yam and Epstein 111 ill , we get the re- 
lation between the fraction of couplings for random coupling 
(denoted by f r , f r = F r /N) and the fraction of couplings for 
large-large coupling (denoted by fi, fi = Fi/N). 

When subnetworks are random, the total degree of coupled 
nodes is 



F, 



5> = *£ 

i=l fcj 



k(k) 



k p -(k) 



k\ 



(6) 



for large-large coupling, where fc; denotes the minimum de- 
gree of the coupled nodes. Thus the fraction of couplings is 



to the synchronization of non-coupled nodes. So less cou- 
plings are needed for system synchronization when (k) in- 
creases. On the other hand, the evolution of subsystems with 
stronger inside interaction is more stable and it needs more 
couplings to drive their evolutions into synchronization J7|]. 
The indirect interaction between non-coupled nodes and the 
stability of subnetworks get a proper match, when (k) takes 
the optimal value. 

Next, we will demonstrate the difference between the ef- 
ficiency of scale-free and random networks for inducing or 
preventing synchronization. To determine the fraction of cou- 
plings needed for synchronization, we consider a node which 
does not take part in direct interaction between two subnet- 
works. The state of this node is determined by its local field, 
hi(t), defined by Eq. (0. The local field includes two types 
of signals, one comes from neighbors which interact with 
nodes of another subnetwork and the other comes from the 
rest neighbors. Thus the total degree of the coupled nodes de- 
termines whether the system can reach the synchronized state 
through the intensity of signals in the mean local field. For the 
the six schemes investigated in Fig. Q] we calculated the crit- 
ical values k c of the total degree of the coupled nodes when 
synchronization occurs. These k c are normalized by the sum 
of the degree of the subnetwork N * (k). The standard devi- 
ation of the critical values is 0.019, while the mean of critical 
total degree of coupled nodes is 0.785. So we argue that syn- 
chronization will occur if the sum of the degrees of coupled 
nodes in one subnetwork exceeds a threshold. 

For convenience of notation, the number of coupled nodes 
is labelled to be F r for random coupling and Fi for large- 
large coupling. When the system is randomly coupled by ei- 
ther scale-free or random subnetworks, the average degree of 
coupled nodes is nearly the same as the average degree of the 



(7) 



So the difference of the fraction of couplings for two coupled 
methods is 



fr - fi 



(fc)*i-i e -< fc > 
(fo-1)! ' 



(8) 



which maximum over ki is obtained approximately by setting 
k[ = (k) + 1/2 for a given value (k) ll ill . 

When subnetworks are scale-free, the degree distribution 
has a power law shape P{k) — Ak^ 1 . The total degree of 
coupled nodes is 



F l poo 

^h = N J kP(k)dk 
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with the ancillary condition 

f-QC 

Fi=N P(k)dk 
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(9) 



(10) 



for large-large coupling. Normalizing the probability distribu- 
tion and assuming a sharp cutoff of the distribution at low k, 
we yield 



(7 _ 2) (7-l) 

(7 — 1)(t -2 ) 



(11) 



Combining Eqs. @, <j9j and ( fTTT ). the relation between fi and 
f r is obtained 



f, = fr 



(7-1)7(7-2) 



(12) 
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FIG. 4: (color online) Comparison numerical results with analytical 
predictions for building couplings to induce synchronization (square) 
or cutting couplings to prevent the system from synchronization (cir- 
cle). Upper panel: the ratio /; //r for scale-free subnetworks as 
of function of the coupling strength (a) and of the average degree of 
subsystems (b). Lower panel: the difference f r — ft for random sub- 
networks as a function of the coupling strength (c) and of the average 
degree of subsystems (d). The thick lines are the maximum of f r — fi 
obtained by analytical calculations. 



For BA model, the degree exponent 7 is equal to 3 [ 13]. Thus 
we have ft = . 

There also exists a threshold of degree for preventing the 
system from synchronization when we cut couplings from the 
globally coupled system. This threshold is equal to the differ- 
ence between N(k) and the threshold of degree for ensuring 
synchronization. Similarly, the relationship between the frac- 
tion of removed couplings for large-large cutting and random 
cutting also follow Eqs. ([8]) and d!21 l. 

Figure Ufa) shows f^ 2 / f T as a function of coupling 
strength when subnetworks are scale-free. In the case of build- 

1 /2 

ing couplings, numerical simulations give that f { / f r = 1, 
which is consistent with Eq. 0121 1. In the case of cutting cou- 
plings, the ratio is larger than the analytical prediction when 
the coupling strength e is small, which results from the fat 
tail Il6ll of BA networks. In other words, the number of nodes 
with large degree is more than that described by the power-law 



distribution. As a result, some extra couplings between large 
degree nodes are removed in simulations and therefore the 
number of cut couplings predicted by analysis is less than that 
of simulations. When coupling strength is strong, the number 
of couplings cut from the coupled system is large, and the sim- 
ulation results close to the analytical prediction. Figure |4f b) 

1 /2 

shows the ratio f l / f r as a function of the average degree 
(k) of scale-free subsystems. For building couplings, simu- 
lation results agree well with the analytical prediction. For 
cutting couplings, the simulation results are greater than the 
analytical calculation in the case of either (k) is low or large. 
The deviation results from the small fraction of couplings in 
these regions as shown in Fig. [3ja). When subnetworks are 
random, the difference f r — fi are shown in Figs. |4fc) andHfd) 
as a function of the coupling strength e and the average degree 
of subnetworks (k). The analytical result of the upper bound- 
ary of f r — fi gives a good limitation to numerical results. 
Although building large-large couplings and removing large 
couplings improve the efficiency in inducing and preventing 
synchronization, the analytical result of random subnetworks 
restricts the enhancement of efficiency to a small range which 
is less than that of scale-free subnetworks. 

In summary, we have studied the influences of the degree 
distribution of networks on mutual synchronization in a two- 
layer neural networks. We investigated three coupling meth- 
ods between two subsystems: large-large coupling, random 
coupling, and small-small coupling. We found that couplings 
between nodes with large degree nodes play an important 
role in the synchronization. For large-large coupling, less 
couplings are needed for inducing synchronization for both 
random and scale-free networks. For random coupling, cut- 
ting couplings between nodes with large degree is very effi- 
cient for preventing neural systems from synchronization, es- 
pecially when subnetworks are scale-free. By assuming that 
the total degree of coupled nodes in subnetworks determines 
the system synchronization, the numerical simulation results 
are interpreted analytically. The analysis reveals that the de- 
gree distribution of subnetworks rather than other topological 
quantities affects the efficiency of systems in synchronization. 
Although our work is based on a simple model of neural sys- 
tems, we think that the results found out in this work is proper 
in more wide and realistic situations in which the dynamics of 
neurons depend on the mean local field. It would be interest- 
ing if Nature takes advantage of the efficiency of the scale-free 
topology in controlling mutual synchronization of interacted 
systems. 
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